MARKET INSIGHTS, INC.
1 Intoduction
Hello, I’m Joseph from Morocco.
Inspired by Hans Rosling’s TED Talk, I taught myself data scraping, analysis, and visualization.
This non-academic approach has given me a unique perspective, as reflected in my projects—though it also means I may require a thorough onboarding process to align with team standards.
I’m open to starting as an intern, either full-time or part-time. Regarding time zones, I’m in UTC+1, but I’m flexible and can adjust my schedule to accommodate the team’s needs.
Feel free to reach me at joseph.ergo@proton.me, and to visit my website for more projects josephelhaddad.github.io.
This custom report, generated from processing 1.4 TB of public data locally, aims to explore the workforce dynamics of a company—up to 2020.
Essentially, I am doing research on a company that does research.
2 About the project
The project came to life after realizing that web scraping doesn’t allow deep-level filtering—without consuming too much time.The irony is, this project itself took me about a month, but the final RDB contains more data than I could ever scrape.
The raw data was 1.4 TB in size and holds information previously scraped.
Processing was done on my local machine using Python, Polars, and DuckDB, following this workflow:
- Processed raw data into structured Parquet files using Polars.
- Transformed each Parquet file into mini RDBs using Polars.
- Merged all mini RDBs into one using DuckDB.
- Analyzed and filtered data to fit the current project.
3 EDA
3.1 market research indestry’s yearly new recruit count
3.2 market insights, inc.’s workforce status over the years
4 Workforce sample
4.1 Abraham Shapiro
Job title: Consultant, price elasticity of demand study
Associated: False
Socials: https://linkedin.com/in/abraham-shapiro-166a23a8
4.1.1 Abraham Shapiro’s working period at market insights, inc.
4.1.2 Gantt plot of Abraham Shapiro’s experience
4.2 Arshia Mohazab
Job title: Coffee shop attendant
Associated: True
Socials: https://linkedin.com/in/arshia-mohazab-577088177
4.2.1 Arshia Mohazab’s working period at market insights, inc.
4.2.2 Gantt plot of Arshia Mohazab’s experience
4.3 Audrey Fitzsimmons
Job title: Market research analyst
Associated: False
Socials: https://linkedin.com/in/audrey-fitzsimmons-00438b40 | https://linkedin.com/in/audreyfitzsimmons
4.3.1 Audrey Fitzsimmons’s working period at market insights, inc.
4.3.2 Gantt plot of Audrey Fitzsimmons’s experience
4.4 Brady Walen
Job title: Director of marketing
Associated: False
Socials: https://twitter.com/bradywalen | https://linkedin.com/in/bradywalen | https://linkedin.com/in/brady-walen-7325735 | https://facebook.com/bradywalen
4.4.1 Brady Walen’s working period at market insights, inc.
4.4.2 Gantt plot of Brady Walen’s experience
4.5 Emilli Durent
Job title: Restaurant
Associated: True
Socials: https://linkedin.com/in/emilli-durent-a19902169
4.5.1 Emilli Durent’s working period at market insights, inc.
4.5.2 Gantt plot of Emilli Durent’s experience
4.6 Eric Benson
Job title: Project manager
Associated: False
Socials: https://linkedin.com/in/eric-benson-028b62
4.6.1 Eric Benson’s working period at market insights, inc.
4.6.2 Gantt plot of Eric Benson’s experience
4.7 Jim Perry
Job title: Senior strategist
Associated: True
Socials: https://linkedin.com/in/jim-perry-69976a3 | https://linkedin.com/in/jasperry | https://twitter.com/mi_jim
4.7.1 Jim Perry’s working period at market insights, inc.
4.7.2 Gantt plot of Jim Perry’s experience
4.8 Kelton Toles
Job title: Research interviewer
Associated: False
Socials: https://linkedin.com/in/kelton-toles-32217138
4.8.1 Kelton Toles’s working period at market insights, inc.
4.8.2 Gantt plot of Kelton Toles’s experience
4.9 Larry Fisher
Job title: Sales manager
Associated: False
Socials: https://linkedin.com/in/larry-fisher-1931145
4.9.1 Larry Fisher’s working period at market insights, inc.
4.9.2 Gantt plot of Larry Fisher’s experience
4.10 Lori Soderholm-Weber
Job title: Senior project manager - chicago and nyc
Associated: False
Socials: https://linkedin.com/in/lori-soderholm-weber-19007b6 | https://linkedin.com/in/lorisoderholm
4.10.1 Lori Soderholm-Weber’s working period at market insights, inc.
4.10.2 Gantt plot of Lori Soderholm-Weber’s experience
4.11 Michaela Cagle
Job title: Research analyst
Associated: True
Socials: https://linkedin.com/in/michaelacagle
4.11.1 Michaela Cagle’s working period at market insights, inc.
4.11.2 Gantt plot of Michaela Cagle’s experience
4.12 Nicole Davis
Job title: Project manager
Associated: False
Socials: https://linkedin.com/in/nicole-davis-409a17
4.12.1 Nicole Davis’s working period at market insights, inc.
4.12.2 Gantt plot of Nicole Davis’s experience
4.13 Prince Patel
Job title: B.com
Associated: True
Socials: https://linkedin.com/in/prince-patel-22184239
4.13.1 Prince Patel’s working period at market insights, inc.
4.13.2 Gantt plot of Prince Patel’s experience
4.14 Sarah Balqis
Job title: Research assistant
Associated: True
Socials: https://linkedin.com/in/sarah-balqis-b25225165
4.14.1 Sarah Balqis’s working period at market insights, inc.
4.14.2 Gantt plot of Sarah Balqis’s experience
4.15 Stacey Hampson
Job title: Regional manager
Associated: False
Socials: https://linkedin.com/in/stacey-hampson-39ab462
4.15.1 Stacey Hampson’s working period at market insights, inc.
4.15.2 Gantt plot of Stacey Hampson’s experience
4.16 Travis Mccafferty
Job title: Project manager
Associated: False
Socials: https://linkedin.com/in/travis-mccafferty | https://linkedin.com/in/travis-mccafferty-148a0731